Efficiency sequencer for multiple concurrently-executing threads of execution

ABSTRACT

Techniques are disclosed for efficiently sequencing operations performed in multiple threads of execution in a computer system. In one set of embodiments, sequencing is performed by receiving an instruction to advance a designated next ticket value, incrementing the designated next ticket value in response to receiving the instruction, searching a waiters list of tickets for an element having the designated next ticket value, wherein searching does not require searching the entire waiters list, and the waiters list is in a sorted order based on the values of the tickets, and removing the element having the designated next ticket value from the list using a single atomic operation. The element may be removed by setting a waiters list head element, in a single atomic operation, to refer to an element in the list having a value based upon the designated next ticket value.

BACKGROUND

Embodiments of the present invention relate generally to multiprocessorsand concurrency in computer systems, and more particularly to techniquesfor synchronizing processing in systems that process eventsconcurrently.

Computer systems can execute program code instructions using one or moreprocessors that perform operations specified by the instructions. Theoperations can produce effects on the state of the computer, forexample, by changing data stored in the computer's memory. The resultsproduced by the instructions can depend on the state of the computer atthe time the instructions are executed and on input received fromsources external to the computer system. A set of program codeinstructions being executed on a computer system is referred to as a“process” or a “thread.” Multiple processes and/or threads can beexecuted concurrently using one or more processors, so that theprocesses and threads execute, or at least appear to execute,simultaneously. That is, each process or thread can be executedsimultaneously by a different processor, or can be executed on the sameprocessor using a technique such as time slicing to share a singleprocessor among multiple instruction streams. In both scenarios,computer systems can allow the different processes or threads to use aresource, such as memory, that is shared among the processes or threads.

If multiple concurrent processes or threads can access and change thesame data value in memory, such as a bank balance variable, then someform of synchronization between the processes or threads is needed,because unsynchronized access to a shared resource can lead to incorrectresults as multiple streams of instructions attempt to modify the sameresource, e.g., the bank balance variable, at essentially the same time,with each stream expecting that there will be no other modifications tothe resource. For example, two different threads may execute theinstructions “balance=balance+5” to add $5 to the bank balance variable.If both threads execute these instructions concurrently withoutsynchronization, then incorrect results may occur. The correct result,after execution of both threads, is an increase of the balance by $10.However, adding $5 to the balance can actually involve multipleinstructions, such as an instruction to read the balance variablefollowed by an instruction to add 5 to the value read from the balancevariable and store the result in the balance variable. Thus, if boththreads execute the first instruction before executing any furtherinstructions, both threads will read the same initial value (e.g., 0 ifthe balance is initially zero), and add 5.00 to that value, which willresult in both threads storing the value 5 in the balance variable,instead of one thread storing 5 and the second thread storing 10, whichis the correct behavior. Executing the threads in sequence, e.g., thefirst thread followed by the second thread, would result in correctbehavior, but may be less efficient than executing the threadsconcurrently. For example, if each thread executes on a correspondingprocessor, then both threads can be executed in essentially the sameamount of time as one thread. If the threads are executed sequentially,then twice as much time may be used for their execution. Further, thereare other advantages to executing multiple threads concurrently. Forexample, resources such as input/output devices can be used moreefficiently by concurrent threads.

Therefore, it is desirable to be able to execute threads concurrently,but synchronization between the threads is needed to ensure correctexecution. With synchronization, each thread can, for example, requestexclusive access to the balance variable before accessing it. Thus eachthread will wait until no other threads are accessing the variablebefore accessing it. Such mutually exclusive access to the sharedresource is useful for maintaining correct behavior of concurrentprograms. However, constructing concurrent programs that operatecorrectly and share resources efficiently can be difficult, becauseidentifying the specific instructions that need to be protected by asynchronization technique, such as mutual exclusion, without protectingmore of the program than necessary, is a complex task.

SUMMARY

In accordance with embodiments of the invention, an efficient sequenceris provided to enable multiple concurrently-executing threads ofexecution to correctly access shared resources such as data in memoryand input/output devices. Shared resources can be accessed by criticalsections of program code, e.g., code that accesses variables that areshared between the processes or threads. Execution threads requestaccess to a critical section (or other shared resource) by presentingticket values to the sequencer, and waiting until their request isgranted before executing the critical section. The sequencer maintains a“next ticket” value that increases over time as threads complete thecritical section. When one thread completes the critical section, thesequencer advances the “next ticket” value and grants any waitingrequest for the new “next ticket” value, thereby enabling another threadto enter the critical section.

Thus a request to access the critical section is granted by thesequencer when the “next ticket” value reaches or exceeds the numberpresented by the requesting thread. The “next ticket” value is advancedto a higher value when a thread requests that the value be advanced,which ordinarily occurs when the thread has completed execution of thecritical section. The sequencer thus enforces the order in which thewaiting requests are granted, and can provide an assurance of the orderin which the threads will enter the critical section (or access a sharedresource), which is useful in applications such as systems with multipleproducer threads and multiple consumer threads that are to be matched.The sequencer maintains a list of waiting threads and associated ticketvalues. This “waiting list” is maintained in an order sorted accordingto the ticket values of the waiting threads in the list. The “nextticket” value represents the value of the next ticket to be granted, andcorresponds to the next thread to be allowed to enter the criticalsection.

According to an embodiment of the present invention, a method isprovided that includes receiving, by a computer system, an instructionto advance a designated next ticket value, incrementing, by the computersystem, the designated next ticket value in response to receiving theinstruction, searching, by the computer system, a waiters list oftickets for an element having the designated next ticket value, whereinsearching does not require searching the entire waiters list, and thewaiters list is in a sorted order based on the values of the tickets,and removing, by the computer system, the element having the designatednext ticket value from the list using a single atomic operation.

Embodiments of the invention may include one or more of the followingfeatures. Removing the element may include setting, by the computersystem, a waiters list head element, in a single atomic operation, torefer to an element in the list having a value based upon the designatednext ticket value. Searching the waiters list may include identifying,by the computer system, a threshold ticket value which is the greatestticket value in the list that is less than or equal to the designatednext ticket value, wherein the searching starts at a waiters list headelement, and removing the element may include setting, by the computersystem, the waiters list head element, in a single atomic operation, torefer to a next element in the waiters list after a threshold elementhaving the threshold ticket value. The tickets in the waiters list maycorrespond to threads, and the method may further include causing, bythe computer system, a thread associated with the element having thedesignated next ticket value to proceed. The method may further includereceiving, by the computer system, a request for a resource, the requestassociated with a request ticket value, storing, by the computer system,the request ticket value in the waiters list in a position in the listthat maintains the sorted order of the list, and causing, by thecomputer system, the request to be blocked until the designated nextticket value is greater than or equal to the request ticket value.

Storing the request ticket value may include searching, by the computersystem, the waiters list, starting at a waiters list head element, foran existing list element associated with an existing ticket value thatis greater than the request ticket value, inserting, by the computersystem, a new list element in the waiters list such that the existinglist element is the next element after the new list element, andassociating, by the computer system, the request ticket value with thenew list element. The method may further include, when insertion of thenew list element fails because of an unexpected value of a list elementnext field, searching, by the computer system, the waiters list startingat the waiters list head element for the existing list elementassociated with the existing ticket value, and retrying the insertion.The request may be associated with a thread of execution, and the methodmay further include associating, by the computer system, the thread ofexecution with the request ticket value in the waiters list.

According to an embodiment of the present invention, a system isprovided that includes a processor configured to receive an instructionto advance a designated next ticket value, increment the designated nextticket value in response to receiving the instruction, search a waiterslist of tickets for an element having the designated next ticket value,wherein the search does not require searching the entire waiters list,and the waiters list is in a sorted order based on the values of thetickets, and remove the element having the designated next ticket valuefrom the list using a single atomic operation.

According to an embodiment of the present invention, a non-transitorymachine-readable medium for a computer system is provided that hasstored thereon a series of instructions executable by a processor, theseries of instructions including instructions that cause the processorto receive an instruction to advance a designated next ticket value,instructions that cause the processor to increment the designated nextticket value in response to receiving the instruction, instructions thatcause the processor to search a waiters list of tickets for an elementhaving the designated next ticket value, wherein the search does notrequire searching the entire waiters list, and the waiters list is in asorted order based on the values of the tickets, and instructions thatcause the processor to remove the element having the designated nextticket value from the list using a single atomic operation.

According to an embodiment of the present invention, a method isprovided that includes receiving, by a computer system, a plurality ofrequests for a resource, the plurality of requests associated with aplurality of request ticket values, selecting, by the computer system,one or more first requests from the plurality of requests, wherein theone or more first requests are associated with one or more requestticket values which are greater than a designated next ticket value,causing, by the computer system, the one or more first requests to waituntil the designated next ticket value is greater than or equal to atleast one of the one or more request ticket values, and storing, by thecomputer system, the one or more request ticket values in a waiters listthat is sorted according to the ticket values.

Embodiments may include one or more of the following features. Themethod may further include: when the designated next ticket value isgreater than or equal to at least one of the one or more request ticketvalues, causing, by the computer system, one or more of the firstrequests associated with one or more of the one or more request ticketvalues that are less than the designated next ticket value to proceed inthe order that the one or more first requests appear in the waiterslist. The resource may be a critical section of program code. Causingthe one or more first requests to wait may include disabling, by thecomputer system, a current thread in which the one or more firstrequests were made. Storing the one or more request ticket values mayinclude inserting, by the computer system, a list element associatedwith one of the one or more request ticket values into the waiters listsuch that the waiters list remains sorted by the ticket valuesassociated with elements of the list.

The method may further include receiving, by the computer system, aninstruction to advance the designated next ticket value, incrementingthe designated next ticket value, searching, by the computer system, thewaiters list to identify a threshold ticket value which is the greatestticket value in the list that is less than or equal to the designatednext ticket value, causing, by the computer system, one or more waitingrequests associated with one or more lesser ticket values to proceed inthe order that the one or more lesser ticket values appear in thewaiters list, wherein the one or more lesser ticket values are less thanor equal to the threshold ticket value, and removing, by the computersystem, the one or more lesser ticket values from the waiters list.

Removing the one or more lesser ticket values from the waiters list mayinclude removing a head element from the list. Causing one or morerequests associated with one or more lesser ticket values to proceed mayinclude enabling one or more threads of execution associated with theone or more requests. The waiters list may be associated with a headpointer that references a head element of the list, the head elementhaving a ticket value less than the ticket values of other elements ofthe list, wherein the threshold ticket value is stored in a thresholdlist element that includes a next pointer referencing a next element inthe list, removing the one or more lesser ticket values from the waiterslist comprises setting the head pointer to the next element, therebyremoving from the list one or more lesser list elements associated withthe one or more lesser ticket values, and causing the one or morewaiting requests associated with one or more lesser ticket values toproceed comprises enabling one or more threads associated with the oneor more lesser list elements.

According to an embodiment of the present invention, a non-transitorymachine-readable medium for a computer system is provided, thenon-transitory machine-readable medium having stored thereon a series ofinstructions executable by a processor, the series of instructionsincluding instructions that cause the processor to receive, from athread of execution, a request for a resource, the request associatedwith a request ticket value that corresponds to the resource,instructions that cause the processor to compare the request ticketvalue to a designated next ticket value, instructions that cause theprocessor to allow the thread to continue execution when the requestticket value exceeds the designated next ticket value, and instructionsthat cause the processor to disable the thread of execution and insert alist element in an ordered list of waiting requests when the requestticket value does not exceed the designated next ticket value, whereinthe list element is associated with the thread and with the requestticket value, and the list is ordered according to the request ticketvalues of the elements.

Embodiments may include one or more of the following features. Theseries of instructions may further include instructions that cause theprocessor to receive an instruction to advance the designated nextticket value by a given quantity, instructions that cause the processorto increment the designated next ticket value by the given quantity,instructions that cause the processor to search the ordered list ofwaiting requests to identify a list element associated with a thresholdticket value, wherein the threshold ticket value is the greatest ticketvalue in the list that is less than or equal to the designated nextticket value, instructions that cause the processor to enable executionof one or more threads associated with one or more list elements havingticket values less than or equal to the threshold ticket value, whereinthe one or more threads are configured to resume execution in the orderthat their associated one or more ticket values appear in the orderedlist, and instructions that cause the processor to remove the one ormore list elements having ticket values less than or equal to thethreshold ticket value from the ordered list.

The instructions that cause the processor to remove the one or more listelements may comprise instructions that cause the processor to remove ahead element from the list. The instructions that cause the processor tosearch the ordered list of waiting requests may comprise instructionsthat cause the processor to begin the search at a head element of thelist of waiting requests. The waiters list may be associated with a headpointer that references a head element of the list, the head elementhaving a ticket value less than the ticket values of other elements ofthe list, wherein the threshold ticket value is stored in a thresholdlist element that includes a next pointer referencing a next element inthe list, and the instructions that cause the processor to remove theone or list elements may include instructions that cause the processorto set the head pointer to the next element, thereby removing from thelist one or more lesser list elements associated with the one or morelesser ticket values, and the instructions that cause the processor toenable execution of one or more threads may include instructions thatcause the processor to enable one or more threads associated with theone or more lesser list elements.

According to an embodiment of the present invention, a system isprovided that includes a processor configured to receive an instructionto advance a designated next ticket value, increment the designated nextticket value in response to receiving the instruction, search a waiterslist of one or more ticket values to identify a threshold ticket valuewhich is the greatest ticket value in the list that is less than orequal to the designated next ticket value, wherein the waiters list issorted by the one or more ticket values, cause one or more waitingrequests associated with one or more lesser ticket values to proceed inthe order that the one or more lesser ticket values appear in thewaiters list, wherein the one or more lesser ticket values are less thanor equal to the threshold ticket value, and remove the one or morelesser ticket values from the waiters list.

Embodiments may provide one or more of the following features. To removethe one or more lesser ticket values from the waiters list, theprocessor may be configured to remove a head element from the list. Tocause one or more requests associated with one or more lesser ticketvalues to proceed, the processor may be configured to enable one or morethreads of execution associated with the one or more requests. Thewaiters list may be associated with a head pointer that references ahead element of the list, the head element having a ticket value lessthan the ticket values of other elements of the list, wherein thethreshold ticket value is stored in a threshold list element thatincludes a next pointer referencing a next element in the list, toremove the one or more lesser ticket values from the waiters list, theprocessor may be configured to set the head pointer to the next element,thereby removing from the list one or more lesser list elementsassociated with the one or more lesser ticket values, and to cause theone or more waiting requests associated with one or more lesser ticketvalues to proceed, the processor may be configured to enable one or morethreads associated with the one or more lesser list elements.

The processor may be further configured to receive a plurality ofrequests for a resource, the plurality of requests associated with aplurality of request ticket values, select one or more first requestsfrom the plurality of requests, wherein the one or more first requestsare associated with one or more request ticket values which are greaterthan the designated next ticket value, cause the one or more firstrequests to wait until the designated next ticket value is greater thanor equal to at least one of the one or more request ticket values, andstore the one or more request ticket values in the waiters list, whereinthe waiters list is sorted according to the ticket values in the list.The resource may include a critical section of program code.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is an illustrative drawing of an efficient sequencer inaccordance with an embodiment of the present invention.

FIG. 2 is an illustrative flow diagram of interaction between anefficient sequencer system and an application in accordance with anembodiment of the present invention.

FIG. 3 is an illustrative flow diagram of a method for processingrequests to access a critical section in accordance with an embodimentof the present invention.

FIG. 4 is an illustrative flow diagram of a method for processingrequests to advance a ticket in accordance with an embodiment of thepresent invention.

FIG. 5 is an illustrative flow diagram of a method for releasing blockedrequests is accordance with an embodiment of the present invention.

FIG. 6 is an illustrative diagram of operations performed by a methodfor processing requests to access a critical section in accordance withan embodiment of the present invention.

FIG. 7 is an illustrative diagram of operations performed by a methodfor processing requests to advance a ticket in accordance with anembodiment of the present invention.

FIG. 8 is a simplified block diagram illustrating a system environmentthat can be used in accordance with an embodiment of the presentinvention.

FIG. 9 is a simplified block diagram illustrating a computer system thatcan be used in accordance with an embodiment of the present invention.

DETAILED DESCRIPTION

In the following description, for the purposes of explanation, numerousdetails are set forth in order to provide an understanding ofembodiments of the present invention. It will be apparent, however, toone of ordinary skill in the art that certain embodiments can bepracticed without some of these details.

FIG. 1 is an illustrative drawing of an efficient sequencer system 100in accordance with an embodiment of the present invention. The system100 facilitates development of concurrent applications 108 by providingefficient synchronization operations that can be used by theapplications 108 to coordinate access to shared data 130 stored in acomputer memory 104. The shared data 130 can contain variables such as ashared variable 132. The system 100 may be a software system, a hardwaresystem, an enterprise system, or the like. For example, the system 100may be a complex enterprise software system and may include a databasesystem and related products provided by Oracle Corporation™ ofCalifornia. As depicted in FIG. 1, the system 100 comprises a computersystem 102, which includes the memory 104, a processor 180, and storagemedia 182 (e.g., a disk, flash memory, or the like). The processor 180can execute an operating system (not shown), which enables the processorto multitask by executing application code 108 in multiple processes 122and/or threads 123 using techniques such as time slicing. In oneexample, each process 122 includes one or more threads 123 that canaccess the data 130 associated with the process 122. There can be morethan one processor 180, in which case each processor can execute one ofthe processes 122 and/or threads 123. The processor 180 retrievesprogram code instructions 106 from the memory 104 and executes theinstructions 106. Other arrangements of processors, processes, and/orthreads are possible. For example, the operating system may provideprocesses 122 but not threads 123, and may provide shared data 130between the processes 122.

The code instructions 106 executed in a process 122 or thread 124 canaccess the data 130, also stored in the memory 104, by reading thevalues of a shared variable 132 from the memory 104 and writing newvalues for the shared variable 132 to the locations in the memory 104 atwhich the variable 132 is stored. Multiple different variables can beaccessed as well, but a single variable 132 is shown for purposes ofexplanation. Sequences of code instructions 108 are referred to hereinas programs, and each program being executed is referred to as a process122. A process 122 can include one or more of the threads 123. Eachthread 123 can be understood as an executing portion of a program or anindependent flow of instructions being executed. Multiple threads 123can execute concurrently using time slicing and/or multiple processors180. In one aspect, each of the threads 123 in a process accesses thesame data 130 associated with the process, so accesses to the data 130by threads in the same process 122 should be synchronized to avoid raceconditions or other potentially incorrect behavior. Each process 122 canbe isolated by the operating system from other processes 122 so thateach process 122 accesses its own region of the memory 104, in whichcase synchronization among multiple processes may not be needed. Eachprocess 122 can also access a shared region of memory 104 that isaccessible to other processes 122, in which case access to the sharedregion of memory 104, such as the variable 132, should be synchronizedor coordinated among the processes to avoid race conditions and otherpotentially incorrect behavior. The techniques described herein apply tocoordination between multiple processes 122 accessing shared data 130 aswell as to coordination between multiple threads 123.

A sequencer 120 provides synchronization operations 154, 156, which canbe used by the application 108 to coordinate access to data 130 that isshared among multiple threads and/or processes, e.g., multipleapplication threads 123 producing data values as part of a long-runningcomputation such as a simulation and storing the data values in theshared data 130, and multiple application threads consuming, i.e.,reading, the data values from the shared data 130 and performingadditional processing. The portion of the application code that accessesthe shared data 130 is shown as the critical section 114. Although anapplication 108 can have many critical sections, one critical section114 is described here for simplicity. Other critical sections in anapplication can be protected using the techniques described herein forthe critical section 114. The application 108 also includes pre-criticalsection code 112, which is executed prior to execution of the criticalsection 114, and post-critical section code 116, which is executed afterthe critical section 114.

To enable applications 108 to coordinate access to the memory locationsof the variables 132 in the shared data, the sequencer 120 provides anawait method (i.e., operation) 154 that can be invoked by an applicationthread 124 prior to a critical section 114 to wait until the thread 124can access the critical section exclusively, i.e., without any of theother threads 123 that may invoke the await method being in the criticalsection 114 at the same time as the thread 124. The sequencer 120 alsoprovides an advance method 156 that can be invoked by the applicationthread 124 after the critical section has been executed, to allowanother thread 126 to access the critical section 114. The sequencer 120also includes a release method 172

Thus the application code 108 should invoke the await method at or nearthe end of the pre-critical section code 112. When invoking the awaitmethod, the application thread 124 passes a ticket number 125, whichshould be used by the thread 124 to uniquely identify itself, to theawait method. The sequencer 120 maintains a “next ticket” number 136,which represents the ticket number of the next thread 126 to be allowedto execute. The await 154 method waits for the invoking thread's ticketnumber 125 to become available (i.e., become greater than or equal tothe next ticket number 136), and returns control to the thread 124 whenthe invoking thread's ticket number 125 is available. The sequencer 120can disable the thread 124 for scheduling purposes, so that the threadwill not unnecessarily consume processor time while waiting for itsticket number. When the thread's ticket is available, the applicationcode 108 can execute the critical section 114, followed by theapplication's post-critical section code 116, which invokes thesequencer's advance method 156 to advance the next ticket value 136,thereby allowing another thread 126 waiting on the next ticket value toexecute. Thus the “next ticket” number is advanced by invocations of thesequencer's advance method 156 by the application after the applicationcompletes the critical section 114. Advancing the “next ticket” numbercauses the sequencer 120 to allow another thread 126 associated with the“next ticket” number to execute the critical section (e.g., by enablingthe thread for scheduling and allowing the thread's call to await toreturn) when thread 124 invokes the sequencer's advance method 156 afterexiting the critical section 114.

As introduced above, in one set of embodiments, application code 108 orother program code instructions request access to a critical section 114by presenting a particular ticket number 125 to the sequencer 120. Eachof the threads 123 in the application can be associated with a ticketnumber 125 that is unique among the threads 123 of the application, andwhen one or more of the threads 123 request access to the criticalsection 114, the sequencer 120 grants one or more of the requests thatare associated with ticket values 125 less than or equal to the “nextticket” value 136. Furthermore, the sequencer 120 blocks, i.e., delays,requests from threads 123 that have ticket values greater than the nextticket value 136 until the “next ticket” value 136 advances to (becomesgreater than or equal to) the ticket values 125 associated with thoserequests.

For example, when the application invokes the await method 154 prior toentering the critical section 114 to wait for a specified ticket valueto be reached, the sequencer can block an application's request (e.g.,await call) by disabling execution of the thread associated with therequest, and, if a ticket value associated with a previously-blockedrequest has been reached (e.g., as a result of an advance call), grant apreviously-blocked request by enabling execution of the threadassociated with the previously-blocked request. The next ticket value136 advances when the application code 108 invokes the advance method ofthe sequencer 120 to increment the next ticket value 136 by a specifiedincrement value 138 (e.g., by 1 to indicate that one thread hascompleted the critical section 114). Thus, to achieve ordered executionof application requests, the requests are associated with unique numbers125, and the requests are granted in the order specified by theassociated numbers 125. By blocking the application thread 124 until thethread's ticket number 125 is reached, the sequencer 120 preventsexecution of the critical section 114 by the thread 124 until requestsfor the critical section 114 by threads with lower ticket numbers arecomplete.

The application's post-critical section code 116 should invoke thesequencer's advance method immediately or soon after executing thecritical section 114, e.g., as the next method invocation after thecritical section 114. The advance method increments the next ticketvalue 136 by a specified increment value. The sequencer 120 then grantsany waiting requests associated with ticket values, up through the newnext ticket value 136, in the order of their associated ticket values135. In one or more embodiments, multiple requests (e.g., invocations ofthe await method) can be associated with the same ticket value 135, inwhich case the multiple requests are granted when the associated ticketvalue is reached by the sequencer 120, but the order in which therequests are granted is undefined (e.g., any order may be selected bythe sequencer).

In one or more embodiments, the sequencer 120 uses a waiting list 140 tostore the ticket numbers 160 for which threads 123 are waiting, alongwith the thread identifiers 162 of the corresponding waiting threads123. The waiting list 140 can be represented as a linked list datastructure, an array, a queue, or other structure. For purposes ofexplanation, the waiting list 140 is described herein as a linked listthat is referenced by a head pointer. The terms waiting list 140 andwaiting list head 140 are used interchangeably herein to refer to thewaiting list, since the head pointer points to the first element 142 ofthe waiting list. The await method 154 creates a waiting list element142 for each request, and inserts the list element 142 into the listsuch that the list remains in sorted order, e.g., by inserting the newlist element 142 into the list immediately after the last list elementthat has a ticket value less than the new list element's ticket value160 using a search of the list. The search starts at the head 140 tofind the insertion point, and the next pointers 164 in the affected listelements 142 are updated appropriately to insert the new list element142 into the list 140. The list element 142 may be, for example, aninstance of a data structure that has a ticket number attribute 160, athread identifier attribute 162, and a next pointer or reference 164that refers to the next list element, or is null if the list element 142is the last element in the list.

In one or more embodiments, the await method 154 operates as follows.First, the await method determines if the requested ticket number 125 isgreater than the next ticket number 136, and, if so, creates a new listelement 142 that references or stores the ticket number 125 passed bythe application 108 in a ticket number field 160. The await method alsostores the thread identifier 124 of the thread that invoked the awaitmethod in a thread identifier field 162. The await method then enqueuesthe new list element 142 in the waiting list 140 such that the listremains in sorted order (as described above), and disables or suspendsthe current thread 124, so that the thread will not continue executionuntil such time as it is enabled by the advance 156 method. The Java™programming language's LockSupport park method can be used, for example,to suspend the thread for scheduling purposes. The await method canproceed only after the thread is enabled for scheduling. If theLockSupport park method is used, the thread is enabled for scheduling,and execution continues by returning from the LockSupport park methodafter another thread calls LockSupport unpark, passing the threadidentifier as the argument. The await method then enters a loop thatchecks whether the next ticket value 136 has reached or exceeded therequested ticket number 125 that was passed to the await method, and, ifnot, invokes the LockSupport park method. Thus the await method 154 doesnot return control to the calling thread 124 until the next ticket value136 has reached (i.e., met or become equal to) or exceeded the requestedticket number 125, and the thread 124 is prevented from executing untilthe await method 154 returns.

In one or more embodiments, the advance method 156 operates as follows.Upon being invoked, the advance method 156 increments the next ticketvalue 136 (e.g., using the AtomicLong atomic update_methods, such asgetAndIncrement, compareAndSet, and the like). The advance method thensearches the waiting list 140 for the last element 142 in the listhaving a ticket value less than or equal to the next ticket value 136,and removes that element and all prior elements (i.e., elements havingequal or lesser ticket values) from the list. The search can, forexample, begin at the head 140 and proceed through the list, followingthe next pointers 164, until the last element having a ticket value 160less than or equal to the next ticket value 136 is found or the end ofthe list (a null next pointer 164) is reached. Once the desired elementis found, the list can be split into two portions by setting the headpointer 140 to the next list element 142, i.e., the element pointed toby the found element's next pointer 164. Thus the first element in thewaiting list 140 having a ticket value equal to or greater than the nextticket value 136 becomes the new head of the waiting list 140. Theadvance method then enables the threads associated with the elements ofthe first portion, i.e., the elements that were removed from the list asa result of changing the head pointer, since the “next ticket” value 136now exceeds the ticket values of those removed elements. Note that insome cases, either the first or second portion (or both) may be empty.The LockSupport unpark method can be used to enable the threads, if theLockSupport park was used to suspend them, or another thread resumemethod can be used to enable the threads. In one example, the threadsare enabled in the order in which they appear in the waiting list,although other orders are possible.

FIG. 2 is a simplified flow diagram illustrating a method 200 ofinteraction between an efficient sequencer and an application accordingto an embodiment. The processing depicted in FIG. 2 may be performed bysoftware (executed by a processor), hardware, or combinations thereof.In one embodiment, the process of FIG. 2 is invoked when an applicationthread invokes the await method of an efficient sequencer, such as thesequencer 180 shown in FIG. 1. As shown at block 202, the applicationthread passes a ticket value to the await method. In one example, theapplication determines the ticket value, and ensures that differentthreads use different ticket values. In another example, the sequencer180 can allocate ticket numbers to application threads. A ticket numbercan correspond to an application thread, but in other examples ticketnumbers can correspond to other entities, and multiple ticket numberscan correspond to a single thread, or multiple threads can correspond toa single ticket number, depending on the details of the application.Block 204 determines if the ticket number received from the applicationin block 202 is less than or equal to the current “next ticket” value.If not, block 206 blocks, i.e., delays, the application thread until thereceived ticket number is greater than or equal to the next ticketnumber. Block 206 can disable the thread for scheduling purposes byinvoking LockSupport park, some other thread suspend method, or thelike, and/or perform a busy wait loop. Once the thread is woken up,e.g., by the advance method (called from a different thread), and thereceived ticket number is greater than or equal to the next ticketnumber, block 206 completes and passes control to block 208, whichremoves the received ticket number (and the associated threadidentifier) from the waiting list. After block 208, or after block 204if block 204 determines that the received ticket is less than or equalto the next ticket, the application executes the critical section atblock 210. After completion of the critical section, the applicationcalls the advance method at block 212. At block 214, the advance methodincrements the next ticket value and wakes up any other threads havingticket values less than or equal to the incremented next ticket value.Block 216 then removes list entries having ticket values less than theincremented next ticket value from the waiting list, and the methodends.

FIG. 3 is a simplified flow diagram illustrating an “await” method 300that processes requests to wait for a ticket to become availableaccording to an embodiment. The processing depicted in FIG. 3 may beperformed by software (executed by a processor), hardware, orcombinations thereof. The method of FIG. 3 blocks the calling thread ifthe ticket is not available, and corresponds to the await method 154described above with reference to FIG. 1 and can be invoked by anapplication, which supplies a requested ticket value, myTicket, torequest exclusive access to a critical section, with access beinggranted when the “next ticket” value reaches the requested ticket value.The method begins at block 301, which receives a request ticket valuemyTicket from an application thread that has invoked the await method.Block 302 determines whether the method will block (i.e., wait, causingthe invoking thread to make no progress until it is unblocked). Themethod will block if the requested ticket value myTicket is greater thanthe “next ticket” value, because the “next ticket” value has not yetreached the requested ticket value. Thus, if block 302 determines thatmyTicket is less than or equal to nextTicket, then the request can begranted, there is no need to block, and the method ends. Otherwise,execution continues at block 304, which creates a new list element 142that includes a thread reference or identifier 162 set to the currentthread and stores the value of myTicket in a ticket field 160.

In one or more embodiments, the waiters are stored in the waiter list inthe total order of their tickets. Thus the unblocking (e.g., release)operation can be optimized to search for blocked threads only in asubset of the waiter list, reducing the wait latency compared to animplementation that would use an unsorted list of waiters. At the sametime, the blocking operation (e.g., await) is slower, compared to addinga waiter to an unsorted list, but the impact of the slower blockingoperation is acceptable, since the blocking thread is more likely tohave no permission to proceed at the time it is adding itself to thewaiter list. Therefore, block 306 inserts the new list element 142 intothe waiting list 140 so that the list remains sorted by the ticketvalues of the elements. For example, the list can be searched startingat the head until the first element 142 having a ticket value 160greater than the ticket value of the new list element is found or theend of the list is reached. If such an element is found, then the newlist element is inserted in the waiting list immediately preceding theelement that was found. That is, the new list element is inserted intothe waiting list such that the existing list element is the next listelement after the new list element. If such an element is not found,then the new element is inserted at the end of the list. The listinsertion can be performed using a single JavaAtomicReferenceFieldUpdater associated with the sequencer for updatinglist element “next” fields to atomically set the “next” field of theelement being appended to, with no need for other thread synchronizationto protect the sequencer's state. For example, the list insertion can beperformed by setting variables h and n to refer to the list head and theelement after the list head (h.next), respectively, then, as long as his not null and n.ticket<myTicket, advancing h and n through the list bysetting h=n and n=n.next. Once that stopping condition is true (n isnull or n.ticket>=myTicket), the new element can be inserted into thewaiters list between h and n by using the AtomicReferenceFieldUpdatercompareAndSet method to set the value of the “next” field of h to referto the new element if the current value of the “next” field of h isequal to n (i.e., the expected next list element; if h.next is not equalto n, then another thread has already updated h.next, and this threaddoes not update h.next). If the update of h.next fails (e.g., becauseh.next does not have the expected current value, which can occur as aresult of a concurrent modification of the list by another thread), thenew insertion position needs to be found. However, since the waiter listis sorted, the search can proceed from the same h, whose ticket isalready known to be smaller than myTicket. Thus the same loop describedabove continues until an insert succeeds. There is no need to rescan thewaiter list when insertion fails. Block 308 then determines if myTicketis still greater than the next ticket value 136 (in case another threadhas updated the next ticket value 136 since the check at block 302). IfmyTicket is less than or equal to the next ticket value 136, then block310 invokes the method of FIG. 5 to release any thread(s) that arewaiting for the current next ticket value 136. Otherwise, block 312parks the current thread, so that the thread will not execute, i.e.,will not use substantial CPU time, until it is released at some futuretime, and the method ends. If the LockSupport park method returns, block312 transfers control back to block 308 to determine whether myTickethas advanced past the next ticket value 136. If so, block 310 releasesthe waiting threads, and the method ends. If not, block 312 calls thepark method again, and the loop between block 312 and 308 repeats untilblock 308 determines that myTicket is less than or equal to the nextticket value 136.

FIG. 4 is a simplified flow diagram illustrating an “advance” method ofprocessing requests to advance a ticket according to an embodiment. Theprocessing depicted in FIG. 4 may be performed by software (executed bya processor), hardware, or combinations thereof. The method of FIG. 4corresponds to the advance method 156 described above with reference toFIG. 1 and can be invoked by an application, which can optionally supplyan increment value that is to be added to the “next ticket” value. Thedefault increment value is 1, i.e., the “next ticket” value is increasedby 1 if no increment value is supplied by the application. Block 402increases the “next ticket” value 136 by the increment value using, forexample, the Java AtomicLong addAndGet method. Block 404 invokes themethod of FIG. 5 to release and thread(s) that are waiting for the nextticket value. Block 406 returns the updated “next ticket” value as aresult, so that the caller can verify that the value has been updated.

FIG. 5 is a simplified flow diagram illustrating a “release” method thatreleases blocked requests according to an embodiment. The processingdepicted in FIG. 5 may be performed by software (executed by aprocessor), hardware, or combinations thereof. The release method ofFIG. 5 releases, i.e., unblocks, blocked requests for one or more ticketnumbers (if any) up to a given ticket value t, re-enables thecorresponding threads, and removes the corresponding list elements fromthe waiting list. This release method is shown in FIG. 1 as a releasemethod 172. The release method can be invoked by, for example, the awaitmethod 154 or the advance method 156. If the waiting list elements wereto be stored without sorting, then searching for eligible waiters wouldinvolve scanning the entire list and performing an atomic operation forevery element being removed from the list. If the waiters were organizedin a singly-linked list, as is the common practice for synchronizationprimitives, both the blocking and unblocking threads would contend tomodify the “next” field of the elements. Thus the search for eligiblewaiters is optimized by storing the waiters in sorted order according totheir tickets, and uses just one atomic operation to update the list.Since the waiting list elements are stored in sorted order (sorted bytheir ticket values), with the list head having the smallest ticketvalue in the list, removing the one or more list elements that haveticket numbers less than or equal to t can be accomplished efficientlyby setting the list head pointer 140 to the last list element that has aticket value less than or equal to t. This list element which is tobecome the new list head 140 is identified at block 502 using theaforementioned list search technique, and the head pointer is set tothis list element at block 504. The new list head element will then havea ticket value less than or equal to t, and any threads entering awaitwith the ticket greater than t will frequently add themselves in theportion of the list after the new head. The threads entering await,concurrently with the release, with the ticket(s) less than or equal tot will only add themselves in the portion of the list preceding the newhead. There is a small chance that the threads entering await willobserve that the next ticket is less than myTicket, but start insertingthe element in the waiter list after another thread advances the ticketand releases all eligible waiters that were already in the list.Sequential consistency between blocks 306 and 308 ensures that even insuch cases the thread in await will not block indefinitely, and willremove the newly-added element from the waiter list. There is no need torescan the waiter list when release finds only a subset of waiters(i.e., more eligible waiters become visible after release ends). Thisdesign reduces contention on head of the waiter list and next fields, asawait only updates next, and advance only updates head, and the threadsthat add their elements to the waiter list after the other threadadvanced the ticket do not contend for the waiter list update, as theyare more likely to observe the waiter list in a consistent state thatdoes not require additional processing. Thus the list head points to thelast waiter that was released. The list starts with a sentinel elementthat has a next pointer to the actual first element in the waiting list.In this way, updating of the list when enqueuing and releasing leavesthe list in a consistent state. The one or more list elements 142 thatare removed from the front of the list as a result of changing the headpointer 140 correspond to the requests to be released. The threads 162associated with those requests are unparked at block 506, whichtraverses through the fragment of the list that was removed from thefront of the list. The original head pointer (prior to the change to thenew list head) identifies the head of the list fragment that istraversed at block 506. For each list element, starting at the originalhead pointer and continuing through the list until the new list headelement that was set in block 504 is reached, block 506 unparks thethread associated with each list element by invoking the LockSupportunpark method on each thread identifier stored in each such listelement, and the method ends.

To improve performance, the release method of FIG. 5 need not beprotected by a method-level synchronization operation. Instead, the onlyoperations in the method that need by synchronized with other operationsis the update of the link head at block 504, which can be performedusing the AtomicReferenceFieldUpdater compareAndSet operation. Toachieve this improved efficiency, the search for the new list head atblock 502 can be performed by setting a local variable h to the listhead pointer (which other threads could modify) and moving two localvariable pointers, p and n, through the waiters list 140, with npointing to the next node after p, in a loop that ends when n points toa list element having a ticket value greater than the threshold ticketvalue t, or is null, indicating that the end of the list has beenreached. When that search loop terminates, the value of p is compared tothe initial list head variable. If p is equal to h, then the methodreturns, since there are no list elements to remove. Otherwise, if p isnot equal to h, then a variable t is set to p's ticket value. ThecompareAndSet method is then invoked to set the head pointer to p. ThecompareAndSet method is invoked in a loop until it succeeds or the listhead pointer 140 has been advanced by another method to a list elementthat has a ticket value greater than or equal to t, since another threadmay have changed the list head pointer 140, in which case thecompareAndSet method tries again with the new list head pointer 140,until it succeeds or the new list head ticket value is greater than orequal to t.

The compareAndSet method succeeds if, when invoked for the list headfield of the sequencer's implementation class, with h as the expectedvalue of the list head field and p as the new value for the list headfield, compareAndSet finds that the list head value is still equal to h.Otherwise, compareAndSet fails if it finds that the list head value isnot equal to h, which can happen if another thread has modified the listhead field since the current thread read last its value into the hvariable. Thus, in the loop, the local variable h is set to the currentvalue of the list head pointer, and h's ticket value is compared to t.If h's ticket value is greater than or equal to t, the method ends.Otherwise, when the list head update loop terminates, block 506 executesanother loop to unpark the threads of the nodes in the list fragment.This unpark loop executes while h is not equal to p, setting h=h.next,invoking LockSupport unpark on h's waiter thread field, and setting h'swaiter field to null in each iteration. After this loop completes, therelease method ends.

FIG. 6 is an illustrative diagram of operations performed by a methodfor processing requests to access a critical section in accordance withan embodiment of the present invention. FIG. 6 illustrates manipulationof the waiters list in an example execution of an await method. Asdescribed above with reference to FIG. 3, the await method inserts a newlist element 616 in the sorted waiting list (block 306). FIG. 6illustrates the state of the waiters list after insertion of a new listelement 616. The await method has been invoked with a request ticketvalue 604 equal to 4. The designated next ticket value 602 is 1, whichis less than the request ticket value (block 302), so requests withticket values greater than 1 will block (i.e., wait), and arerepresented by elements of the waiters list. Thus a new list element 616is created to represent the request ticket value 604 that would wait(block 304). A waiter list head pointer (or reference) 608 points to thefirst (i.e., head) element 610 in the waiters list. The element 610stores (or points to) a waiter thread identifier (null in this example,since the head element is a sentinel element, and its waiter has beenwoken up in the past) and an existing ticket value (0), which representsthe ticket value for which the element 610 was waiting. The element 610also has a next pointer, which previously pointed to an existing listelement 612, but has been changed by the await method to point to a newlist element 616 that the await method has created (block 304) andinserted into the list (block 306) immediately preceding the firstelement 612 in the list having an existing ticket value greater or equalto the request ticket value of 4. The new list element 616 has beeninserted into the list. The next field of the new element 616 has beenset to point to the existing list element 612. There is no need tosearch the list past the element 612, so a subsequent list element 614is not accessed in this invocation of the await method. Since the nextticket value 602 of 1 is still less than the request ticket value 604 of4 (block 308), the await method also parks (i.e., suspends) the currentthread (block 312), which is the thread T1 and is identified by thewaiter thread attribute of the new element 616. Since block 308 hasdetermined that myTicket>nextTicket (i.e., the request ticket 604 valueof 4 is greater than the designated next ticket value 602 of 1), block310, which invokes the release method to unblock any eligible waiters,is not executed, and the release method is not invoked.

FIG. 7 is an illustrative diagram of operations performed by a methodfor processing requests to advance a ticket in accordance with anembodiment of the present invention. FIG. 7 illustrates the manipulationof the waiters list in an example execution of an advance method. Asdescribed above with reference to FIG. 5, the advance method incrementsthe next ticket value 702, and invokes the release method. The nextticket value 702 is initially 4, and is incremented to 5 by theillustrated invocation of the advance method. The release method thensearches the waiters list for the last (i.e., farthest from the head ofthe list) element having a ticket value less than or equal to the nextticket value 702 of 5 (block 502). The element 712 is found by thesearch, since the element 712 has a ticket value of 5, and is the lastelement having a ticket value<=the designated next ticket value 702. Theticket value of element 712 (i.e., 5) is thus the threshold ticketvalue, and the ticket values of blocks 716 (4) and 712 (5) are referredto herein as “lesser” ticket values. The ticket value of element 710 isimmaterial at this point, since element 710 is a sentinel element. Theelements with the lesser ticket values are removed from the list whenblock 504 sets the waiters list head 708 to the element found in block502 (i.e., element 712, which now becomes the sentinel element of thelist).

There is no need to search the list past the element 712, so asubsequent list element 714 is not accessed in this invocation of theawait method. Since the waiting list elements are stored in sortedorder, searching for eligible waiters involves scanning from thebeginning of the list until an element having the next ticket value isfound. Since the difference between the previous and next ticket valuesis ordinarily a small constant (e.g., 1 if the application advances thenext ticket value by 1 between each call to the advance method), theselist operations involved in advancing the next ticket value canordinarily be performed as constant time operations, e.g., with runtimesindependent of the length of the list. Since the one or more listelements having ticket values less than (or equal to) the next ticketvalue are removed from the list in a single operation, a single atomicoperation can be used in a multithreaded environment to update the list.There is no need to perform an atomic operation for every element beingremoved from the list (e.g., by the release method).

Block 712 becomes a dummy or sentinel list element, so that there isalways at least one element in the waiters list during ordinaryoperation. In other embodiments, the list can be manipulated indifferent ways, e.g., block 714 could alternatively become the new headof the waiters list, with corresponding changes to the other methods,such as the await method. Thus elements 710 and 716 are removed from thelist, and can be deleted from memory. The release method unparks thethreads of the lesser list elements, i.e., the threads referred to bythe waiter thread attributes of elements 716 and 712. These elementsrefer to threads T1 and T2, respectively, so threads T1 and T2 will beunparked (i.e., allowed to proceed or resume). The list updatesperformed by the release method are now complete, and the waiters listhead 708 now points to the element 712, with the element 714 remainingin the list to represent a request for ticket value 6. The state of thelist after completion of the release method is shown with the releaseddata in dashed lines and the remaining data in solid lines.

FIG. 8 is a simplified block diagram illustrating a system environment800 that can be used in accordance with an embodiment of the presentinvention. As shown, system environment 800 can include one or moreclient computing devices 802, 804, 806, 808, which can be configured tooperate a client application such as a web browser, a UNIX/Solaristerminal application, and/or the like. In various embodiments, clientcomputing devices 802, 804, 806, 808 can correspond to computer system102 of FIG. 1.

Client computing devices 802, 804, 806, 808 can be general purposepersonal computers (e.g., personal computers and/or laptop computersrunning various versions of Microsoft Windows and/or Apple Macintoshoperating systems), cell phones or PDAs (running software such asMicrosoft Windows Mobile and being Internet, e-mail, SMS, Blackberry, orother communication protocol enabled), and/or workstation computersrunning any of a variety of commercially-available UNIX or UNIX-likeoperating systems (including without limitation the variety of GNU/Linuxoperating systems). Alternatively, client computing devices 802, 804,806, 808 can be any other electronic device capable of communicatingover a network, such as network 812 described below. Although systemenvironment 800 is shown with four client computing devices, it shouldbe appreciated that any number of client computing devices can besupported.

System environment 800 can further include a network 812. Network 812can be any type of network familiar to those skilled in the art that cansupport data communications using a network protocol, such as TCP/IP,SNA, IPX, AppleTalk, and the like. Merely by way of example, network 812can be a local area network (LAN), such as an Ethernet network, aToken-Ring network and/or the like; a wide-area network; a virtualnetwork, including without limitation a virtual private network (VPN);the Internet; an intranet; an extranet; a public switched telephonenetwork (PSTN); an infra-red network; a wireless network (e.g., anetwork operating under any of the IEEE 802.11 suite of protocols, theBluetooth protocol known in the art, and/or any other wirelessprotocol); and/or any combination of these and/or other networks.

System environment 800 can further include one or more server computers810 which can be general purpose computers, specialized server computers(including, e.g., PC servers, UNIX servers, mid-range servers, mainframecomputers, rack-mounted servers, etc.), server farms, server clusters,or any other appropriate arrangement and/or combination. Server 810 canrun an operating system including any of those discussed above, as wellas any commercially available server operating system. Server 810 canalso run any of a variety of server applications and/or mid-tierapplications, including web servers, FTP servers, CGI servers, Javavirtual machines, and the like.

System environment 800 can further include one or more databases 814. Inone set of embodiments, databases 814 can include databases that aremanaged by server 810. Databases 814 can reside in a variety oflocations. By way of example, databases 814 can reside on a storagemedium local to (and/or resident in) one or more of computers 802, 804,806, 808, and 810. Alternatively, databases 814 can be remote from anyor all of computers 802, 804, 806, 808, and 810, and/or in communication(e.g., via network 812) with one or more of these. In one set ofembodiments, databases 814 can reside in a storage-area network (SAN)familiar to those skilled in the art.

FIG. 9 is a simplified block diagram illustrating a computer system 900that can be used in accordance with an embodiment of the presentinvention. In various embodiments, computer system 900 can be used toimplement any of computers 802, 804, 806, 808, and 810 described withrespect to system environment 800 above. As shown, computer system 900can include hardware elements that are electrically coupled via a bus924. The hardware elements can include one or more central processingunits (CPUs) 902, one or more input devices 904 (e.g., a mouse, akeyboard, etc.), and one or more output devices 906 (e.g., a displaydevice, a printer, etc.). Computer system 900 can also include one ormore storage devices 908. By way of example, the storage device(s) 908can include devices such as disk drives, optical storage devices, andsolid-state storage devices such as a random access memory (RAM) and/ora read-only memory (ROM), which can be programmable, flash-updateableand/or the like.

Computer system 900 can additionally include a computer-readable storagemedia reader 912, a communications subsystem 914 (e.g., a modem, anetwork card (wireless or wired), an infra-red communication device,etc.), and working memory 918, which can include RAM and ROM devices asdescribed above. In some embodiments, computer system 900 can alsoinclude a processing acceleration unit 916, which can include a digitalsignal processor (DSP), a special-purpose processor, and/or the like.

Computer-readable storage media reader 912 can be connected to acomputer-readable storage medium 910, together (and, optionally, incombination with storage device(s) 908) comprehensively representingremote, local, fixed, and/or removable storage devices plus storagemedia for temporarily and/or more permanently containingcomputer-readable information. Communications system 914 can permit datato be exchanged with network 812 and/or any other computer describedabove with respect to system environment 800.

Computer system 900 can also comprise software elements, shown as beingcurrently located within working memory 918, including an operatingsystem 920 and/or other code 922, such as an application program (whichmay be a client application, Web browser, middle tier/serverapplication, etc.). It should be appreciated that alternativeembodiments of computer system 900 can have numerous variations fromthat described above. For example, customized hardware can be used andparticular elements can be implemented in hardware, software, or both.Further, connection to other computing devices such as networkinput/output devices can be employed.

Computer readable storage media 910 for containing code, or portions ofcode, executable by computer system 900 can include any appropriatemedia known or used in the art, such as but not limited tovolatile/non-volatile and removable/non-removable media. Examples ofcomputer-readable storage media include RAM, ROM, EEPROM, flash memory,CD-ROM, digital versatile disk (DVD) or other optical storage, magneticcassettes, magnetic tape, magnetic disk storage or other magneticstorage devices, or any other medium that can be used to store dataand/or program code and that can be accessed by a computer.

Although specific embodiments of the invention have been describedabove, various modifications, alterations, alternative constructions,and equivalents are within the scope of the invention. Further, althoughembodiments of the present invention have been described with respect tocertain flow diagrams and steps, it should be apparent to those skilledin the art that the scope of the present invention is not limited to thedescribed diagrams/steps.

Yet further, although embodiments of the present invention have beendescribed using a particular combination of hardware and software, itshould be recognized that other combinations of hardware and softwareare also within the scope of the present invention.

The specification and drawings are, accordingly, to be regarded in anillustrative rather than restrictive sense. It will be evident thatadditions, subtractions, and other modifications may be made thereuntowithout departing from the broader spirit and scope of the invention asset forth in the following claims.

What is claimed is:
 1. A method comprising: receiving, by a computersystem, an instruction to advance a designated next ticket value;incrementing, by the computer system, the designated next ticket valuein response to receiving the instruction; inserting, by the computersystem, a ticket into a waiters list of tickets stored in a memory ofthe computer system to preserve a sorted order of a plurality of ticketsin the waiters list using a value of the ticket provided by a waiterassociated with the ticket, wherein the ticket in the waiters listcorresponds to a thread; searching, by the computer system, a part ofthe waiters list in the memory identifying the ticket as having thedesignated next ticket value, without searching the entire waiters listby identifying a threshold ticket value which is the greatest ticketvalue in the waiters list that is less than or equal to the designatednext ticket value, wherein the searching starts at a waiters list headelement; removing, by the computer system, the ticket from the waiterslist using a single atomic operation by one of setting the waiters listhead element to refer to a next element in the waiters list after athreshold element having the threshold ticket value, and setting thewaiters list head element to refer to another ticket in the waiterslist; and causing, by the computer system, a thread associated with theticket to proceed.
 2. The method of claim 1, further comprising:receiving, by the computer system, a request for a resource, the requestincluding the value of the ticket provided by the waiter; and causing,by the computer system, the request to be blocked.
 3. The method ofclaim 2, wherein inserting the ticket into the waiters list comprises:searching, by the computer system, the waiters list, starting at awaiters list head element, for an existing list element associated withan existing ticket value that is greater than the value of the ticket;inserting, by the computer system, a new list element in the waiterslist such that the existing list element is the next element after thenew list element; and associating, by the computer system, the value ofthe ticket with the new list element.
 4. The method of claim 3, furthercomprising: when insertion of the new list element fails because of anunexpected value of a list element next field, searching, by thecomputer system, the waiters list starting at the waiters list headelement for the existing list element associated with the existingticket value, and retrying the insertion.
 5. The method of claim 2,wherein the request is associated with a thread of execution, the methodfurther comprising: associating, by the computer system, the thread ofexecution with the value of the ticket in the waiters list.
 6. Themethod according to claim 1, wherein the plurality of tickets are in thesorted order in which tickets having a greater ticket value are insertedinto the waiters list before tickets having a lesser value.
 7. Themethod according to claim 1, wherein the designated next ticket valuecorresponds to a next thread allowed to access a shared resource.
 8. Asystem comprising: a memory storing a designated next ticket value and awaiters list of tickets; and a hardware processor configured to: receivean instruction to advance the designated next ticket value; incrementthe designated next ticket value in response to receiving theinstruction; insert a ticket into the waiters list of tickets stored inthe memory to preserve a sorted order of a plurality of tickets in thewaiters list using a value of the ticket provided by a waiter associatedwith the ticket, wherein the ticket in the waiters list corresponds to athread; search a part of the waiters list identifying the ticket ashaving the designated next ticket value, without searching the entirewaiters list by identifying a threshold ticket value which is thegreatest ticket value in the waiters list that is less than or equal tothe designated next ticket value, wherein the searching starts at awaiters list head element; remove the ticket from the waiters list usinga single atomic operation by one of setting the waiters list headelement to refer to a next element in the waiters list after a thresholdelement having the threshold ticket value, and setting the waiters listhead element to refer to another ticket in the waiters list; and cause athread associated with the ticket to proceed.
 9. The system of claim 8,wherein the processor is further configured to: receive a request for aresource, the request including the value of the ticket provided by thewaiter; and cause the request to be blocked.
 10. The system of claim 9,wherein to insert the ticket into the waiters list, the processor isfurther configured to: search the waiters list, starting at a waiterslist head element, for an existing list element associated with anexisting ticket value that is greater than the value of the ticket;insert a new list element in the waiters list such that the existinglist element is the next element after the new list element; andassociate the request ticket value with the new list element.
 11. Thesystem of claim 9, wherein the request is associated with a thread ofexecution, and the processor is further configured to associate thethread of execution with the value of the ticket in the waiters list.12. A non-transitory machine-readable medium for a computer system, thenon-transitory machine-readable medium having stored thereon a series ofinstructions executable by a processor, the series of instructionscomprising: instructions that cause the processor to receive aninstruction to advance a designated next ticket value; instructions thatcause the processor to increment the designated next ticket value inresponse to receiving the instruction; instructions that cause theprocessor to insert a ticket into a waiters list of tickets stored in amemory of the computer system to preserve a sorted order of a pluralityof tickets in the waiters list using a value of the ticket provided by awaiter associated with the ticket, wherein the ticket in the waiterslist corresponds to a thread; instructions that cause the processor tosearch a part of the waiters list in the memory identifying the ticketas having the designated next ticket value, without searching the entirewaiters list by identifying a threshold ticket value which is thegreatest ticket value in the waiters list that is less than or equal tothe designated next ticket value, wherein the searching starts at awaiters list head element; instructions that cause the processor toremove the ticket from the waiters list using a single atomic operationby one of setting the waiters list head element to refer to a nextelement in the waiters list after a threshold element having thethreshold ticket value, and setting the waiters list head element torefer to another ticket in the waiters list; and instructions that causethe processor to cause a thread associated with the ticket to proceed.13. The machine-readable medium of claim 12, the series of instructionsfurther comprising: instructions that cause the processor to receive arequest for a resource, the request including the value of the ticketprovided by the waiter; and instructions that cause the processor tocause the request to be blocked.
 14. The machine-readable medium ofclaim 13, wherein the instructions that cause the processor to insertthe ticket into the waiters list comprise: instructions that cause theprocessor to search the waiters list, starting at a waiters list headelement, for an existing list element associated with an existing ticketvalue that is greater than the value of the ticket; instructions thatcause the processor to insert a new list element in the waiters listsuch that the existing list element is the next element after the newlist element; and instructions that cause the processor to associate thevalue of the ticket with the new list element.
 15. The machine-readablemedium of claim 14, the series of instructions further comprising:instructions that cause the processor to, when insertion of the new listelement fails because of an unexpected value of a list element nextfield, search the waiters list starting at the waiters list head elementfor the existing list element associated with the existing ticket value,and retry the insertion.